From Almost Gaussian to Gaussian Bounding Differences of Differential Entropies
نویسندگان
چکیده
We consider lower and upper bounds on the difference of differential entropies of a Gaussian random vector and an almost Gaussian random vector after both are “smoothed” by an arbitrarily distributed random vector of finite power. These bounds are important to prove the optimality of corner points in the capacity region of Gaussian interference channels. The upper bound, presented in MaxEnt-2014, follows from the data processing inequality (DPI). For the lower bound we consider a class of almost Gaussian distributions and use the DPI and a symmetry argument. We also show a counterexample that disproves a conjecture we proposed in MaxEnt-2014 regarding a certain difference of integrals.
منابع مشابه
From Almost Gaussian to Gaussian
We consider lower and upper bounds on the difference of differential entropies of a Gaussian random vector and an approximately Gaussian random vector after they are “smoothed” by an arbitrarily distributed random vector of finite power. These bounds are important to establish the optimality of the corner points in the capacity region of Gaussian interference channels. A problematic issue in a ...
متن کاملNumerical solution of second-order stochastic differential equations with Gaussian random parameters
In this paper, we present the numerical solution of ordinary differential equations (or SDEs), from each order especially second-order with time-varying and Gaussian random coefficients. We indicate a complete analysis for second-order equations in special case of scalar linear second-order equations (damped harmonic oscillators with additive or multiplicative noises). Making stochastic differe...
متن کاملdeBruijn identities: from Shannon, Kullback–Leibler and Fisher to generalized φ -entropies, φ -divergences and φ -Fisher informations
In this paper we propose a generalization of the usual deBruijn identity that links the Shannon differential entropy (or the Kullback–Leibler divergence) and the Fisher information (or the Fisher divergence) of the output of a Gaussian channel. The generalization makes use of φ -entropies on the one hand, and of φ -divergences (of the Csizàr class) on the other hand, as generalizations of the S...
متن کاملThe Effects of Different SDE Calculus on Dynamics of Nano-Aerosols Motion in Two Phase Flow Systems
Langevin equation for a nano-particle suspended in a laminar fluid flow was analytically studied. The Brownian motion generated from molecular bombardment was taken as a Wiener stochastic process and approximated by a Gaussian white noise. Euler-Maruyama method was used to solve the Langevin equation numerically. The accuracy of Brownian simulation was checked by performing a series of simulati...
متن کاملStable Gaussian radial basis function method for solving Helmholtz equations
Radial basis functions (RBFs) are a powerful tool for approximating the solution of high-dimensional problems. They are often referred to as a meshfree method and can be spectrally accurate. In this paper, we analyze a new stable method for evaluating Gaussian radial basis function interpolants based on the eigenfunction expansion. We develop our approach in two-dimensional spaces for so...
متن کامل